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MINIMIZATION  ON  STOCHASTIC  MATROIDS 


by; 

Michael  P.  Bailey 
Naval  Postgraduate  School 
Monterey,  CA  93943-5000 

Abstract 

This  work  gives  a  methodology  for  analyzing  matroids  with  random  element 
weights,  with  emphasis  placed  on  independent,  exponentially  distributed  element 
weights.  The  minimum  weight  basic  element  in  such  a  structure  is  shown  to  be  an 
absorbing  state  in  a  Markov  chain,  while  the  distribution  of  weight  of  the  minimum 
weight  element  is  shown  to  be  of  phase-type.  We  then  present  two  sided  bounds  for 
matriods  with  NBUE  distributed  weights,  as  well  as  for  weights  with  bounded 
positive  hazard  rates.  We  illustrate  our  method  using  the  transversal  matroid  to 
solve  stochastic  assignment  problems. 
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1.  INTRODUCTION 

Matroid  theory  has  its  origins  in  the  recognition  by  Whitney  [1935]  that  some 
algebraic  systems  shared  several  properties  with  linear  independence  systems. 
These  systems,  called  matroid  independence  systems,  were  shown  by  Edmonds 
[1971]  to  have  a  close  relationship  to  the  greedy  algorithm  for  linear  objective 
functions.  The  minimum  weight  spanning  tree,  the  maximum  weight  transversal, 
and  the  fractional  knapsack  problem  are  three  of  the  well  known  combinatorial 
optimization  problems  with  matroid  structures.  This  paper  treats  stochastic 
versions  of  these  problems  where  element  weights  are  independent,  exponentially 
distributed  random  variables.  We  also  establish  bounds  on  the  expected  objective 
function  value  of  the  optimal  basic  element  for  new-better-than-used  (NBUE) 
weights,  and  for  weights  with  positive  bounded  hazard  rates. 

There  exists  some  literature  on  the  subject  of  randomly  weighted  minimum 
weight  spanning  trees,  where  the  weights  are  i.i.d.  exponentials.  In  Freize  [1985],  the 
minimum  weight  spanning  tree  on  complete  graphs  with  i.i.d.  arc  weights  was 
considered.  It  was  shown  that  the  weight  of  the  spanning  tree  approaches  a  constant 
as  the  number  of  nodes  increases. 

Mamer  and  Jain  [1988]  provided  bounding  arguments  for  spanning  trees  in 
networks  using  the  so-called  exodic  spanning  tree.  Corea  [1989],  and  Weiss  [1986] 
indicate  how  bounding  can  be  done  on  shortest  path  systems  using  phase-type 
distributions.  We  develop  bounds  for  matriod  minimizations  with  NBUE  weights, 
where  the  required  phase-type  distribution  is  the  one  we  develop  in  this  paper. 

Kulkarni  [1988]  gave  a  method  for  finding  the  distribution  of  the  weight  of  the 
minimum  spanning  tree  in  an  arbitrary  network  with  independent,  exponentially 
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distributed  weights.  He  provided  methods  for  finding  a  variety  oi  measures  of 
performance  of  the  spanning  tree  based  on  properties  of  a  constructed  Markov 
process.  The  methodology  in  the  current  paper  extends  the  work  done  by  Kulkarni 
to  general  matroid  structures. 

2.  COMBINATORIAL  UNDERPINNINGS 

In  this  section,  we  briefly  discuss  some  combinatorial  properties  of  matroids 
given  in  standard  references  such  as  Lawler  [1976].  We  then  give  several  results 
which  are  essential  to  our  discussion  of  matroids  with  random  weights. 

Let  E  be  a  finite  set  of  objects  such  as  vectors,  nodes,  or  arcs.  is  a  set  of  subsets 
of  E  with  the  following  two  properties: 

2.1)  Y  e  £Vf  and  X  C  Y,  then  X  e 

2.2)  (X  C  A:  X  e  f\f:  there  exists  no  xe  A  such  that  X  u  {x}  e  i M) 
is  an  equicardinal  set  for  every  subset  A  of  E. 

Property  2  1  says  every  subset  of  a  set  in  ‘M  is  in  *M,  thus  f\f  is  called  simplical. 
Property  2.2  dictates  that  every  maximal  feasible  subset  of  a  set  A  contains  the  same 
number  of  elements  for  every  A  C  E.  We  will  denote  the  set  of  maximal  elements 
in  M  as  p^,  called  the  basis  of  ‘M  and  will  call  members  of  p^  basic  elements.  We 
will  consistently  use  n  to  denote  the  cardinality  of  a  basic  element. 

Properties  2.1  and  2.2  combine  to  guarantee  that  we  can  begin  with  the  empty  set 
d,  and  construct  any  set  in  3^  by  making  n  selections  from  the  set  E.  We  will 
perform  this  construction  of  a  basic  element  by  greedy  minimization. 

Let  v  be  a  nonnegative  weight  function  on  the  set  E,  v:  E  — >  9\\  The  linear 
objective  function  co  on  elements  of  tW  is  given  by 
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*>M  =  X  V'M 

xeX 

for  each  X  &  94.  For  the  time  being,  we  will  ignore  the  possibility  of  sets  of  equal 
weights.  In  the  sequel,  the  weight  of  each  element  of  E  will  be  an  absolutely 
continuous  random  variable,  so  that  equally  weighted  strings  occurr  with 
probability  zero.  The  notion  of  greediness  is  formalized  by  the  following  algorithm: 


0.  initialize:  X  =  <p,  to  =  0 

1.  x^argminy;Xuyg^v(y) 

2.  w  < —  w  +  v(x) 

3.  X  < —  Xux 

4.  if  X  e  (3 51/  then  go  to  step  1 

5.  stop 

Figure  2.1.  The  Greedy  Algorithm 

Verbally,  the  greedy  algorithm  begins  with  the  empty  set  X  =  p  and  at  each  stage 
selects  the  element  x  e  E-X  with  smallest  weight,  subject  to  the  constraint  that  X  u 
{x}  is  in  :V.  Let  XG  be  the  basic  element  constructed  by  the  greedy  algorithm,  Xc  = 
j.vj’ ,xV , ...  ,.vG |  where  xf  is  the  element  selected  at  the  ith  opportunity.  Let 
X,*”  =  {xj',xf,...,xjr’]  be  the  set  of  the  first  i  greedy  selections.  Note  that  the  terminal 
value  of  co  is  equal  to  the  linear  objective  function  value  of  Xc.  The  critical 

connection  between  the  greedy  algorithm  and  matroid  structures  is  given  bv  the 
following  theorem,  directly  adapted  from  results  of  Edmonds. 

Theorem  2.1.  Let  co  be  a  linear  objective  function  for  an  arbitrary  nonnegative 
weight  function  v,  then  XG  =  arg  minycp^co(Y)  if  and  only  if  94  is  a  matroid. 
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Proof:  See  Lawler  Section  8.3,  replacing  maximization  with  minimization 

throughout.  • 

As  will  become  apparent,  we  will  need  to  modify  the  objective  function  and 
greedy  algorithm  in  order  to  handle  stochastic  element  weights.  Let  us  define  an 
alternate  objective  function  cod,  which  we  will  call  the  discounted  linear  objective 
function,  as  follows: 

=  X  v<*) + (”  Hxl)[™ax  v(x)} 

Consider  Figure  2.2,  with  v(x)  indicated  by  the  lengths  of  the  bars  shown,  for 


Figure  2.2a  Linear  Objective  Function 


Figure  2.2b.  Discounted  Linear  Objective  Function 
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HHH1  =  accumulated  cost  after  1X1=3 
=  cost  of  adding  x4 

The  shaded  area  in  Figure  2.2a  indicated  the  magnitude  of  ct^Xj),  while  the 
shaded  area  of  Figure  2.2b  indicates  the  magnitude  of  cod(^X^J.  We  accompany  the 
new  objective  function  with  a  modified  greedy  algorithm  we  call  the  greedy 
algorithm  with  discounting,  shown  in  figure  2.3. 

Denote  the  element  Pm  which  terminates  this  algorithm  as  XD. 

Lemma  2.2.  XD  =  XG. 

Proof:  We  perform  simple  induction  on  the  size  of  the  set  X.  At  initialization,  X  = 
p,  and  v(x)  =  r(x)  for  all  x  e  E.  Hence  Step  1  in  each  algorithm  is  identical.  Suppose 

that  we  now  have  generated  the  set  Xf  e  M  using  the  standard  greedy  algorithm. 

We  compare  each  element  in  the  set  [y: Xf  u  {y}  €  tw}  to  determine  which  has 

smallest  weight,  and  declare  the  chosen  element  xf+r  Because  iM'has  property  2.1,  we 
know 

{y:  Xf  u {y}  e  *{)  c  ({y: 0  u  {y}  e  *{} n  {y: Xf  u  {y}  €  }n...n{y: X'l,  u [y]},e  ). 

Thus,  we  are  guaranteed  that 

r(x^)  =  i^f;,)-(r(xf)  +  r(4')+...+r(A.f )) 

which  is  the  minimum  of  the  set  u  |.v)  e  ^}.  Thus,  x)’+J  will  be 

selected  by  the  greedy  algorithm  with  discounting  at  stage  i  +  1. 

Thus,  we  are  assured  that  xcj  is  selected  by  the  greedy  algorithm  with 

discounting  at  each  stage  j  =  1,  2, ...,  n.  • 

Theorem  2.3.  Let  XD  be  the  discounted  linear  objective  function  for  an  arbitrary, 
nonnegative  weight  function  v,  then 
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XD  =  argminy,^  ^(Y) 


if  and  only  if  ‘M  is  a  matroid. 

Proof:  Since  the  greedy  algorithm  with  discounting  always  makes  the  same 
selections  as  the  standard  greedy  algorithm,  this  theorem  follows  directly  from 
lemma  2.1.  • 

0.  Initialize  X  =  <p,r(x)  =  Z’(x)Vx  e  E,£o<,  =  0 

1.  x^argminy;JMy}€Slf  r(y) 

2.  OJj  <-  (od  +[r(x)(«-|X|)] 

3.  For  each  y  e  E  -  X 

r(y)  <-  r(y)-r(x) 

4.  XVXu{.v} 

5.  if  X  e  then  go  to  step  1 

_ 6.  stop _ 

Figure  2.3.  The  Greedy  Algorithm  with  Discounting 

Example  1  One  of  the  more  interesting  weighted  matroid  structures  is  the 
transversal  matroid.  Let  (S,  T,  A)  be  a  bipartite  graph  with  source  node  set  S, 
destination  node  set  T,  and  arc  set  A  connec*;ng  members  of  S  to  members  of  T.  For 
example,  let  (S  T,  A)  be  as  given  in  Figure  2.4.  Each  node  t  in  T  has  a  specified  cost 
v(t).  The  matroid  minimization  problem  is  to  find  the  minimum  weight  subset  of  T 
such  that  each  member  of  this  subset  can  be  matched  with  a  unique  element  in  S, 
and  each  element  of  S  has  a  member  of  T  matched  to  it.  This  assignment  is  called  a 
transversal  of  the  bipartite  graph.  Such  a  problem  might  arise  where  each  element 
of  T  is  a  task  requiring  specialized  training  and  each  member  of  S  is  a  person.  An  arc 
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exists  between  pe  S  and  te  T  if  and  only  if  person  p  is  qualified  to  undertake  the 
training  for  task  t.  {n(t):t  e  T}  is  the  set  of  training  costs.  Note  that  training  costs  do 

not  vary  from  person  to  person.  The  goal  is  to  employ  the  members  of  S  the  greatest 
extent  possible  while  minimizing  the  training  budget.  See  Lawler  to  verify 
properties  2.1  and  2.2  for  the  transversal  matroid  is  a  matroid. 

The  bases  for  the  transversal  matroid  are  given  in  Table  2.1  below.  All  basic 
elements  have  cardinality  4.  Even  if  there  existed  no  complete  matching  from  S  to 
T,  each  element  of  pv  would  still  be  of  the  same  cardinality. 

We  show  the  execution  sequence  of  the  standard  and  the  discounted  greedy 
algorithms  in  Tables  2.2  and  23  below.  Note  that  the  accumulated  cost  and  the 
terminating  basic  set  are  consistent  with  the  values  given  in  Table  2.1.  Also  note 
that  r(3)  decreases  below  0.  This  only  happens  because  3  is  not  addable  to  (4,6)  or  any 
superset  of  (4,6). 


Figure  2.4.  Bipartite  Graph  with  Node  Weights 


TABLE  2.1.  THE  BASIS  OF  THE  TRANSVERSAL  MATROID 


Xep™ 

Matching  in  S 

Cost 

{1,2,  3, 4} 

1,3,  2,4 

62 

(1,2,  3,  5} 

1,3,  2,4 

70 

(1,2,  4,5} 

1,2,  3,4 

65 

(1,2,  4,6} 

1,3, 4,2 

69 

U,2,5,6) 

1,3,  4,2 

77 

{1,3,  4,5} 

1,2,  3,4 

58 

{1,4,  5,  6) 

1,3,  4,2 

57 

(2,  3,  4,  5} 

3,  2,1,4 

57 

{2,4,  5,6} 

3,  1,4,2 

56 

TABLE  2.2. 

STANDARD  GREEDY  ALGORITHM  EXECUTION  PATH 

STAGE i 

Xi 

0) 

0 

0 

0 

1 

(41 

8 

"■) 

{4,6} 

20 

3 

14,  5,  6} 

36 

4 

{2,  4,  5,  6} 

56 

TABLE  2.3.  GREEDY  ALGORITHM  WITH  DISCOUNTING  EXECUTION  PATH 

STAGE  i  X, 

r 

0 
32 
44 
52 
56 

We  should  note  that  the  transversal  matroid  is  not  reducible  to  the  graphic  matroid 
from  wnich  the  minimum  weight  spanning  tree  problem  arises.  Thus,  the  results 
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concerning  transversal  matroids  with  random  arc  weights  we  will  present  in  the 
next  section  are  new  to  the  literature. 


3.  MATROID  MINIMIZATION  WITH  EXPONENTIAL  ELEMENT  WEIGHTS 

Let  jV(y):yeE]  be  a  set  of  independent,,  exponentially  distributed  random 

variables  with  arbitrary  rates  |A(y):y  e  Ej,  and  let  Wd  be  the  associated  stochastic 
discounted  linear  objective  function. 

We  propose  that  a  properly  constructed  Markov  process  will  have  the  property 

that 

i)  at  each  transition  it  will  make  transition  from  X  u  {x}  with  probability  equal 
to  the  probability  that  the  greedv  algorithm  would  choose  x  from  X; 

ii)  the  time  between  entry  to  state  X  and  entry  into  state  X  u  { x }  is  identically 
distributed  with  the  random  quantity  W(X  u  {x})  -  W(X). 

Once  this  is  established,  we  will  use  the  first-passage  properties  of  the  s  ochastic 
process  from  o  to  some  state  in  (5 v  to  describe  the  stochastic  properties  of  the  greedv 
algorithm  and  its  solution.  We  now  consider  the  case  where  our  matroid  is 
randomly  weighted. 

Let  Z  be  a  Markov  process  with  statespace  %  absorbing  states  (J.y,  and  initial  state 


0  Define  A(X)=  £  A(.v).  Let  Q  be  the  infinitesimal  generator  matrix  of  Z , 

x  X  ■ 

defined  as 


Qh  V 


_  A(H) 

""-M 
_  -m 

n-|K) 

=  0 


H,Ku)k}  e  flf 


otherwise 
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The  fundamental  result  of  this  section  is  given  as  follows: 

Theorem  3.1.  For  each  X  e  let  Prft)  =  P[Z(t)  =  X],  then 

P[W,(XG)  <  t,XG  =  X]  =  P[Z(f)  =  X]  =  Px(t). 

Note  that  XG  is  now  a  random  set  in  P# 

Proof.  We  use  a  sample  path  argument  based  on  the  current  state  of  Z.  Let 
T, ,  t2  , . . . ,  t„  be  the  intertransition  times  of  Z.  At  the  outset,  Z(0)  =  0. 

W,(X]c)  =  «miny£rV(y)~«exp  £%)  -exp  . 

^ye£  )  Vy €C  n  V 

G 

Once  X!  has  been  chosen,  we  have 


r(x)  =  V{x)  -  V(x'c)  -  exp(A(x)) 

for  each  r6E-{.r|'j(  where  the  distribution  is  established  by  the  strong  Markov 
property.  Thus,  we  have 


W(X2c)-W(XG)~exp 


■y  X.(x) 


X  X;  <_>{x(€^< 


Hence,  we  can  inductively  establish  that 


w(xr;,)-w(xf')-exp 


I 


Our  theorem  follows.  • 

To  address  questions  of  interest  regarding  the  performance  of  a  randomly 
weighted  matroid,  we  may  use  the  cumulative  joint  distribution  {Px(f),f  >  0,X  e 
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to  derive  probabilities  of  interest.  We  now  present  a  series  of  corollaries  to  the 
preceding  theorem.  The  first  result  concerns  the  distribution  of  W(XG). 

Modify  the  rate  matrix  Q  by  aggregating  all  the  basic  elements  of  M  into  a  simple 
absorbing  state  which  we  will  label  (3^  to  created  the  rate  matrix  Q'.  Let 

Qx.p*  =  A(X)  |X(  =  w  —  1 

O'  =0  ■  |X|*»-1 

KXY  ><X,Y'  1 

.Pm  ~  °‘ 

Let  Z'  be  the  Markov  process  governed  by  the  generator  Q'. 

Corollary  3.2. 

p{w(Xc)<t]  =  P[Z(t)  =  l3„]. 


Let  rx  =  E[time  until  absorption|Z’(0)  =  X],  We  can  calculate  e[w(Xg)]  by  solving  for 
V 

We  can  solve  for  e[vV(X1')J  by  solving  for  according  to 


|K|  =  n  —  l 


r  =  n  ~  N  |  V  AiHir 

H  m  MHt 

n  y  A(k) 


|K|  =  n-2.n-3 . 1 


This  is  the  first  step  analysis  result  found  in  Heymann  and  Sobel  [1982]  adapted  to 
the  process  Z'.  Note  that  =  0. 

Often,  one  is  not  only  interested  in  the  value  of  W(X1’).  Sometimes  we  seek  the 
probability  that  a  given  state  is  the  greedy  choice  or  the  probability  that  a  given 
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element  is  a  member  of  XG.  The  appropriate  probability  weight  function  can  be 
easily  found  using  the  embedded  Markov  chain  of  Z'. 

For  each  Xeflf  and  x  such  that  X  u  {*}  e  ‘M  let 

Let  z  be  the  discrete  time  Markov  chain  governed  by  transition  probability 
matrix  P,  with  Zo  =  <p. 

Corollary  3.3.  For  each  X  e 

P[XG  =  X]  =  P[zn  =  X]. 

Proof:  We  simply  take  the  ratio  of  Qx  Xux  and  Qx,x-  Note  that  the  factor  of  n  -  |  X  | 
cancels.  • 

Corollary  3.4.  For  x  e  E,  define  px  as 

P[.r  e  XG]  =  P[x  e  z„]  =  px. 

This  last  result  is  concerned  with  the  probability  that  a  given  element  in  the  set  E  is 
a  member  of  the  optimal  basic  element.  px  is  often  called  the  criticality  index  of  x, 
and  is  important  because  it  tells  us  the  extent  to  which  the  performance  of  the 
system  depends  on  the  random  variable  V(x). 

There  exist  specific  applications  which  require  specialized  performance 
measures  such  as  E|w(X0)|.r  e  XGj,  p[x  e  Xc|y  e  XG|;  or  P[«(XG)  <  f  *|.v  e  Xc,|  for 

some  t*>0.  Each  of  these  measures  may  be  derived  using  standard  Markov  process 
analysis  techniques.  For  further  discussion  of  these  techniques,  see  Bailey  [1988]. 
Example  2.  Returning  to  our  task  assignment  example,  suppose  that  the  cost  of 
training  for  each  task  is  now  exponentially  distributed  with  mean  given  in  figure 
2.4.  The  appropriate  Markov  process  was  constructed  with  nine  absorbing  states,  37 
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transient  states,  and  upper  triangular  structure  Figures  3.1  and  3.2  show  the 
distribution  and  density  functions,  resp.,  for  the  random  variable  W(XG). 


_ota'  ~ra  n;no  Cost 

Figure  3.1  The  Distribution  of  W(XC) 
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2C  4C  6C  8C  ICC 

“ota'  “ra'rvnc  Cost 

Figure  3.2.  The  Density  of  W(XG) 

Using  the  system  of  equations  given  above,  we  calculated  the  expected  value  of 
W(XC)  as  35.1256.  Note  that  this  value  is  about  57%  of  the  deterministic  value  of 
W(XC)  given  in  Section  2  even  though  the  individual  expected  costs  in  both  cases 
are  equal.  This  reduction  in  expected  training  costs  becomes  more  dramatic  as  the 
size  of  the  problem  increases.  In  Table  3.1,  we  give  the  probability  of  absorption  for 
each  basic  element,  and  we  show  the  criticality  index  for  each  task  in  Figure  3.3.  The 
criticality  index  in  this  context  gives  the  probability  that  a  given  task  is  undertaken 
under  the  minimum  training  cost  policy. 
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TABLE  3.1.  PROBABILITY  OF  OPTIMALITY  FOR  EACH  BASIC  ELEMENT 


P[XG  =  X] 

0.11124010 

0.03319019 

0.04504579 

0.13018686 

0.15166172 

0.16070031 

0.15705219 

0.19037344 


X 

11,2,3,4} 
(1,2,  3,  5} 
{1,2,4,  5} 
(1,2,4,  6} 
(1,3,4,  5} 
{1,4, 5,  6} 
(2,  3,4,  5} 
{2,4,  5,6} 


Task 

Figure  3.3.  Probability  each  Task  is  Undertaken 
Our  analysis  shows  that  task  4  is  almost  always  undertaken  (p4=95%),  task  5  is 
usually  undertaken  (ps=74%),  and  the  pairs  1  and  2,  and  3  and  6  are  nearly  equally 
likely  to  be  undertaken.  The  deterministic  solution,  {2,4,5,6},  is  most  likely  to  be  the 
optimal  solution  but  its  probability  is  only  19%. 
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4.0  BOUNDS  FOR  NONEXPONENTIALLY  DISTRIBUTED  WEIGHTS 

This  section  presents  two  methods  for  using  exponentially  weighted  matroids  to 
provide  performance  bounds  for  randomly  weighted  matroids.  In  the  first  case,  we 
consider  the  general  class  of  NBUE  weights.  We  provide  a  simple  bound  on  the 
expected  weight  of  the  optimal  basic  element  based  on  a  concavity  argument.  The 
second  bound  applies  to  weight  distributions  which  have  positive  bounded  hazard 
rate  function  on  the  nonnegative  halfline.  We  develop  bounds  in  distribution  for 
the  weight  of  the  optimal  basic  element,  and  give  formulae  which  quantify  the 
worst-case  tightness  of  the  bounds.  In  both  cases,  we  illustrate  our  methodology 
using  the  transversal  matroid. 

4.1  NBUE  Distributions  and  Concave  Bounds 

The  deterministic  objective  function  (Od  is  concave  in  each  of  its  arguments. 
This  fact  allows  us  to  state  that  the  random  variable  Wd(M),  the  weight  of  the 
minimum  weight  basic  element  when  element  weights  are  exponential,  establishes 
a  concave  lower  bound  on  Wd(NBUE),  where  element  weights  have  NBUE 
distributions  with  the  same  means  as  the  exponentials.  The  power  of  this  statement 
is  fully  revealed  in  the  inequality 

a id  >  E[Wd(NBUE)]  >  E[Wd(M)], 

see  Stoyan  [1983]. 

Example  3.  We  used  our  small  example  of  the  transversal  matroid  to  compare 
results  using  two  interesting  families  of  NBUE  distributions,  the  uniform  and  the 
Weibull  families. 
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Our  experiment  involved  selecting  distributions  ranging  from  those  with  very 
low  coefficient  of  variation  (0.013)  to  coefficients  of  variation  near  unity.  We 
expected  the  performance  to  be  close  to  that  of  the  exponential  system  when  the 
coefficients  were  high,  and  nearly  deterministic  when  they  were  low.  We  felt  that, 
even  for  this  very  small  example,  this  transition  would  be  interesting  to  observe. 

For  the  uniform  distributions  we  parameterized  distributions  using  R  as  follows 

f ^  =  2Rv(x)  W)  - Rvtx),  vtx)  +  Rv(x)l 

for  each  xe  E.  We  chose  values  of  0.2,  0.5,  and  1.0  for  R.  For  the  Weibull 
distribution,  given  as 

f(z)  =  aPzP-lexpf-azP]  7(0  ^(z), 

we  chose  p  =  1.5,  2,  5,  and  10,  and  adjusted  the  rate  parameter  a  so  that  the  random 
weights  had  expected  values  equal  to  the  deterministic  values  of  v(x)  given  in  the 
example  in  Section  2.  For  each  distribution,  we  generated  1000  problem  instances 
and  generated  a  data  set  of  objective  function  values  and  criticality  information.  We 
used  this  data  to  verify  the  above  inequality.  Figure  4.1  shows  the  relationship  of 
the  expected  values  of  the  optimal  tasking  cost  using  the  distributions  given  above. 
This  figure  verifies  the  above  inequality  for  our  small  example. 
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Figure  4.1a.  Expected  Value  Bounds  for  Uniform  Task  Values 

In  Figure  4.2,  we  constructed  quantile-quantile  plots  for  the  uniform  and  VVeibuI! 
distributions.  The  45  degree  line  represents  the  exponential  density  and  the 
horizontal  line  represents  the  deterministic  value  of  w=56.  As  we  expect,  these  two 
lines  nicely  sandwich  the  distribution  of  Wd  for  each  family. 
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Figure  4.1b.  Expected  Value  Bounds  for  Weibull  Task  Values 
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Figure  4.2a.  Q-Q  plot  for  uniform  vs.  exponential  weights.  The  quantile-quantile 
curves  progress  from  the  45  degree  line  as  R  decreases.  The  deterministic  system  is 

represented  by  the  horizontal  line  at  56. 
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Figure  4.2b.  Q-Q  plot  for  Weibull  vs.  exponential  weights.  The  curves  progress 
from  the  45  degree  line  as  p  increases.  The  deterministic  system  is  represented  by 

the  horizontal  line  at  56. 

Finally,  we  computed  the  criticality  indices  for  the  two  distributional  families, 
and  present  these  results  as  bar  graphs  in  Figure  4.3.  This  figure  leads  to  some 
interesting  insights  about  the  bounding  behavior  of  criticality  indices.  It  seems  that 
the  very  critical  tasks,  tasks  four  and  five,  have  their  criticality  indices  bounded  from 
below  by  the  exponential  case.  A  similar  behavior  is  shared  by  task  six,  though  it  is 
no  more  critical  than  tasks  one  or  two.  Tasks  one  through  three  exhibit  very  little 
systematic  behavior.  • 

In  conclusion,  we  have  shown  that  the  concave  bounds  provided  by  the 
exponential  and  deterministic  cases  hold,  and  that  other  comparisons  of  NBUE 
systems  to  exponential  ones  display  interesting  structures  and  relationships.  We 
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more  precise  statements  about  behavior  as  the  system  grows  large.  Other  analyses, 
such  as  that  of  Frieze  [1985],  are  more  applicable  in  large-scale  systems.  Finally,  we 
should  note  that  all  of  the  above  bounding  arguments  hold  when  each  of  the 
element  weights  comes  from  a  distinct  NBUE  family.  Thus,  for  any  combination  of 
IFR,  IFRA,  NBU  and  NBUE  weights,  we  still  have  bounds,  and  the  bounds  probably 
behave  in  the  manner  we  have  described  with  respect  to  coefficient  of  variation. 


Figure  4.3a.  Criticality  indices  from  uniform  task  values 
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4.2  Weights  with  Positive,  Bounded  Hazard  Functions 

In  this  section,  we  consider  weights  which  are  nearly  exponential,  having 
bounded  hazard  functions.  Let  IV( x)  ~  Fx:  x  e  Ej  be  a  set  of  weights,  and  define  the 
usual  hazard  rate  function 

fx(t) 

r>(t)~n  -  fx  (t))' 

where  t\  is  the  distribution  corresponding  to  the  distribution  function  Fx  .Suppose 
that  for  each  xe  E,  we  have  superior  and  inferior  hazard  bounds,  AsfxJ  and  A‘(x),  such 
that  for  all  t  >  0 
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tXHx)  <  J  rx(s)ds  <  tX'(x), 

this  model  of  near  exponentiality  being  attributable  to  Glazebrook  [1987],  Barring 
the  case  of  Xs (x)  =  0,  this  guarantees  that  V(x)  has  nontrivial  support  on  [0,°°].  Define 
exponential  weights  Vs(x)  and  V'(x),  with  rates  Xs(x)  and  X‘(x),  resp.,  with  which  we 
can  bound  V(x)  in  distribution 

V'(x)  <d  V(x)  <d  VHx), 

see  Barlow  and  Proschan  [1981].  Let  \N(V),  W(V'),  and  W(VS,)  be  the  (random) 
weight  of  the  minimum  weight  basis  element  under  weights  (V(x):xe E},  (V‘(x),xe E), 
and  (V'(x>:x€ El,  resp. 

Theorem  4.1:  W(V')  <d  W(V)  <d  W(VS) 

Proof:  We  will  show  the  inequality  W’(V)  <d  VV(VS)  holds,  lea\'ing  the  other 
inequality  to  the  reader.  Let  us  impose  an  arbitrary  numbering  on  the  elements  of  F, 
so  that  E  =  le j,  c ...,  e  jr, },  and  define  random  weight  function  V ^  as  {WiY?),  VHez), 

....  VHck),  V(t'k.i).  V(ek.z) .  V(e\£\)}.  w,  the  deterministic  linear  objective  function, 

is  monotone  increasing  in  each  argument. 

We  have 


W(V)  <d  W(V:), 

a  result  or  monotonicity  of  w  in  V(ei).  By  a  simple  inductive  argument,  we  establish 
that  W(Vk)  Sj  W(Vk  +  j)  for  k  =  1,2,  ...,  I  El  -  I.  Transitivity  gives  us  that  W’(V)  <j 
W(V\z  )  =  W(VS).  • 
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Let  x  e  E.  We  consider  the  difference  Vs(x)  -  V'(x),  where  both  these  random 
variables  arise  from  the  same  element  of  the  sample  space,  thus  they  are  completly 
dependent.  Thus,  if  X'(x)  =  Xs(x)  +  e(x),  we  have  that 


VHx)  =  VHx)  ■ 


XHx) 

Xs(x)+e(x) 


using  the  method  of  matched  realizations.  Hence  we  calculate  the  probability 
distribution  of  the  difference  of  these  two  weights  as 


P[VHx)  -  VHx)  >  t] 


We  will  use  this  result  to  bound  P[(W(VS)  -  W(V')  >  t],  using  the  sojourn  times  on 
the  sample  path  to  each  basic  element. 

Let  X  e  Pbe  an  (ordered)  string  of  elements  of  E.  Conditioned  on  X  =  XG,  we  can 
use  the  sample  path  of  the  Markov  processes  Xs(t)  and  XHl)  based  on  (VHx):  x  e  E) 

and  {VHt):  x  e  E]  with  matched  realizations  to  bound  the  distribution  of  W(VS)  - 
W(V').  Let  be  the  sojourn  time  of  X5(t)  in  state  X;,  then  by  theorem  3.1, 


By  equation  (4.2.1),  we  have  that 
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P  Tj-Tj>t\X=XG  =exp  -t  £ 

^  xeA(Xj)  - 


Xs(x){Mx)+e(x)) 
e(x)  (n-j) 


Thus,  as  W(VS)  -  W(V 0  =  (f0  -  f0)  +  ('fj  -  t\)  +  ...  +  (fn_7  -  we  get  the  following 


bound. 


As(j:)(Asfx)+e(x)) 

Lemma  4.2.  Let  X  e  Sand  r,(X)  =  T  - ; — - ; - . 

xeA(Xj)  e(x)  (n-]) 

If,  as  we  expect,  { Tj(X):j=0,  1,  2, ...,  n-1)  is  a  set  of  n  distinct  reals,  then 


P[W(V V  -  W(V‘)  >t]=  X  PIX=XC]  £  fl/x;  exp(-fr;(X)) 

Xe/s  V  ;=°  > 


(4.2.2) 


<  max  £  a;00  exp(-ttj(X)) 
Xe/3  po 


Vi  XlXk) 

.•here  a/X)  =  1|  - r 

k=o  (A (Xk)~  Afx,)) 


Proof:  Conditioned  on  X  =  Xc,  W(VS)  -  W(V')  is  the  convolution  of  n  independent 
exponential  random  variables  with  distinct  rates  (r )(X):j  =  0,  1,  2,  n-1 }  Hence 

VVYVW  -  IVH/1)  is  hyperexponential  with  the  rates  given  by  this  set.  The  form  given 
in  (4.2.3)  is  found  in  Trevedi  [1982].  • 

The  bound  given  in  (4.2.2)  is  verv  sharp,  and  cannot  be  improved  upon  without 
knowledge  of  P[X=XC],  A  looser  bound  which  does  not  require  exact  criticality  data 
is  given  below.  Suppose  that 


As(x)(As(x)  +  dx)) 


x  =  argmin- 

xeE 
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Then,  by  4.2.1,  P[Vs(x)  -  V‘(x)  >t]  <  P[Vs(x*)  -  V‘(x*)  >  t]  for  every  x  e  E. 

Aj  =  minXe<M,jxhi 

Theorem  4.3: 

P[W(V*)  -  MV')  >  t] 


X  b>  exp 


r 

'lHx*)(V(x*)  +  £(x*) ) 

Ai  } 

-t 

V 

e(x*) 

(n-j) ) 

where 


T—r  *k(n-j) 

11  Ak(n-j)  -  Aj(n-k) 


k*i 


Proof:  Let  Xefi,  then  T;(x)  >  Aj 


>  min 

xep 


XHx'HVix*)  +  £(X*)) 
e(x*)  (n-j) 

?J(x*)  (aHx*3  +  e(x*))  Aj 


ax*)  (n-j)' 

Thus,  bv  rescaling  the  transition  sojourns  by  e(xVIXs(x*){\s(x*)+e(x*)) 
we  derive 


/j  (n!(W  -  w(v<)) 


£(X') 


?J<x*)(ls<x*)  +  E(xV) 


>t  I  X=  XG 


where 


< 


n  f 

J~[  bj(Xj)  exp  -t 

M  ' 


V(x*)(XHx*)+e(x*)) 

e(x*) 


(n-j)  j 


Ak(n-j) 

Ak(n-j)  -Aj(n-k) 


k*j 


Let 
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and  the  theorem  result  follows  by  replacing  x*  and  X*  to  bound  the  conditional 
probability  for  each  X  e  [3. 

Example  4.  We  explored  the  behavior  of  the  bounds  by  varying  the  value  of  e(x). 
Using  the  same  parameters  (X(x):  x  e  E)  as  those  of  example  2,  we  varied  Xs(x)  and 
tl[x)  such  that  (1  -  p)X(x)  =  Xs{x)  and  U  +  p)X(x)  =  X{(x)  for  p  =  0.1,  0.7,  and  0.5.  The 
cumulative  probability  functions  were  plotted,  and  are  presented  as  figure  4.4. 

The  results  show  a  healthy  robustness  with  respect  to  mild  departures  from 
exponentiality.  The  widest  pair  of  curves,  corresponding  to  p  =  0.5,  show  the 
distribution  for  the  case  where  A'Yx)  -  Xs(x)  =  l(x),  thus  we  have  a  100%  gap  between 
lower  and  upper  bounds  on  the  hazard  function.  Even  in  this  extremely  weak 
bounding  of  the  hazard  function,  we  get  useful  results  about  the  weight  of  the 
minimum  weight  basic  element. 


p 

r 

o 

t 

a 

t 


value  of  r. 

-  -C. 


c  c 

C  I 


r  ^ 


t 

Figure  4.4.  Bounds  for  ^s(x)  =  (1  -  pR(x),  A.'(x)  =  (1  +  pR(x)  for  p  =  0.1,  0.2,  and  0.5. 
The  cdf  of  the  original  problem  in  the  bold  cu.ve  marked  0.0. 

We  also  plotted  the  behavior  of  the  bound  presented  in  theorem  4.3,  the  result  is 

shown  in  figure  4.5.  The  bounding  behavior  is  very  strong  for  this  problem,  so 

strong  that  we  are  virtually  guaranteed  that  the  value  of  W(VS)  -  W(V')  is  less  than 

0.5  in  all  cases,  even  when  the  bounds  on  the  hazard  function  r(x)  are  very  loose. 

This  behavior  arises  due  to  the  minimization  mechanism  underlying  W.  Our 

intuition  tells  us  that,  as  the  problem  structure  becomes  larger,  the  values  of  Aj,j  = 

0,  2,  ...,  n  -  2,  will  become  large,  causing  the  resulting  bound  to  be  increasingly  sharp. 
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5.  CONCLUSIONS  AND  EXTENSIONS 

We  have  presented  a  method  for  finding  performance  measures  of  any- 
minimized  weighted  matroid  optimization  problem  where  the  ground  set  elements 
have  independent,  exponentially  distributed  weights.  Further,  we  have  shown  the 
exponential  case  to  be  useful  in  providing  bounds  on  random  matroids  with  nearly 
exponential  weights,  and  NBUE  weights. 

Optimization  problems  which  are  amenable  to  the  work  in  this  paper  include 
the  semimatching  problem,  the  minimum  weight  spanning  tree  problem,  the  job 
sequencing  problem,  the  flow  matrix  synthesis  problem,  and  the  experimental 
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design  problem.  The  details  of  each  of  these  problems  can  be  found  in  Chapter  Eight 
of  Lawler. 

Each  of  these  optimization  problems  must  be  considered  well-solved  for  the  case 
of  exponential  element  weights,  the  solution  being  found  in  the  present  paper.  We 
have  further  provided  a  general  bounding  scheme  for  any  choice  or  mixture  of 
NBUE  distributions  for  ground  set  element  weights. 

Several  works  concerning  minimum  weight  spanning  trees  present  results 
which  are  asymptotic  in  the  number  of  nodes  in  the  graph  examined,  these  results 
holding  for  generally  distributed  weights.  The  only  constraint  is  that  these 
distributions  must  be  continuous  from  the  right  at  V(x)=0.  Among  these  papers  are 
Frieze  [1985],  and  Mamer  and  Jain  [1988],  These  papers  make  use  of  the  fact  that,  as 
|{x:Xu{x)e  we  have  min  ^  V'(jc)  is  approximately  exponentially  distributed. 

Similar  asymptotics  could  be  performed  on  the  general  matroid  problem  with 
generally  distributed  element  weights.  Elegant  results  such  as  those  given  by  Frieze 
are  thus  obtainable  using  the  Markov  process  presented  in  this  paper  combined  with 
some  (usually  complex)  counting  arguments. 

The  results  presented  in  this  paper  lend  further  evidence  supporting  the 
usefulness  of  Markov  processes  as  greedy  minimization  processes  in  combinatorial 
optimization  problems  with  random  weights.  While  methods  of  deterministic 
parametric  analysis  commonly  used  in  optimization  work  address  the  case  where  an 
individual  weight  is  allowed  to  vary,  these  methods  do  not  address  the  larger 
problem,  that  the  optimal  objective  function  value  is  a  complex  function  of  all 
weights.  The  methods  given  in  this  paper  are  clearly  more  difficult  to  perform  than 
the  usual  parametric  analysis,  however,  we  have  demonstrated  that  the  parametric 
methods  will  yield  inaccurate  results. 
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